Clarifying Assumptions about Intraoperative Stress during Surgical Performance: More Than a Stab in the Dark: Reply

Ó The Author(s) 2011. This article is published with open access at Springerlink.com We thank Dr. Ali for his concise annotation of our efforts to validate a tool that evaluates mental workload in surgery [1, 2]. Unlike other safety critical domains, the field of surgery has been slow to acknowledge the impact of intraoperative stress on surgical performance, but recently a sea change has been triggered by authorities in the field of surgical education [3]. We agree with Ali that stress is not by default detrimental to performance. Our aim was to develop a diagnostic tool that identifies the factors that contribute to disrupted performance, should it occur. Indeed, studies of the effects of acute stress on operating performance have shown considerable variability, ranging from no effect to either facilitative or debilitative effects [3–5]. The Yerkes-Dodson law emerged from the earliest attempts to explain the relationship between physiological arousal and performance, but it has been criticized for treating stress as a unitary construct, influenced solely by physiological factors [6]. More recently, Catastrophe Theory has been invoked to model the relationship, using both physiological and psychological (cognitive anxiety) components of stress [7]. The model proposes that physiological arousal displays a mild inverted-U relationship with performance when cognitive anxiety is low, but that catastrophic declines in performance can occur if both physiological arousal and cognitive anxiety are high. Recent surgical literature has elucidated the complexity of M. Wilson (&

Psychomotor control in a virtual laparoscopic surgery training environment: gaze control parameters differentiate novices from experts

Background: Surgical simulation is increasingly used to facilitate the adoption of technical skills during surgical training. This study sought to determine if gaze control parameters could differentiate between the visual control of experienced and novice operators performing an eye-hand coordination task on a virtual reality laparoscopic surgical simulator (LAP Mentor™). Typically adopted hand movement metrics reflect only one half of the eye-hand coordination relationship; therefore, little is known about how hand movements are guided and controlled by vision. Methods: A total of 14 right-handed surgeons were categorised as being either experienced (having led more than 70 laparoscopic procedures) or novice (having performed fewer than 10 procedures) operators. The eight experienced and six novice surgeons completed the eye-hand coordination task from the LAP Mentor basic skills package while wearing a gaze registration system. A variety of performance, movement, and gaze parameters were recorded and compared between groups. Results: The experienced surgeons completed the task significantly more quickly than the novices, but only the economy of movement of the left tool differentiated skill level from the LAP Mentor parameters. Gaze analyses revealed that experienced surgeons spent significantly more time fixating the target locations than novices, who split their time between focusing on the targets and tracking the tools. Conclusion: The findings of the study provide support for the utility of assessing strategic gaze behaviour to better understand the way in which surgeons utilise visual information to plan and control tool movements in a virtual reality laparoscopic environment. It is hoped that by better understanding the limitations of the psychomotor system, effective gaze training programs may be developed. © 2010 The Author(s).published_or_final_versionSpringer Open Choice, 01 Dec 201

Perceptual impairment and psychomotor control in virtual laparoscopic surgery

Background: It is recognised that one of the major difficulties in performing laparoscopic surgery is the translation of two-dimensional video image information to a three-dimensional working area. However, research has tended to ignore the gaze and eye-hand coordination strategies employed by laparoscopic surgeons as they attempt to overcome these perceptual constraints. This study sought to examine if measures related to tool movements, gaze strategy, and eye-hand coordination (the quiet eye) differentiate between experienced and novice operators performing a two-handed manoeuvres task on a virtual reality laparoscopic surgical simulator (LAP Mentor™). Methods: Twenty-five right-handed surgeons were categorised as being either experienced (having led more than 60 laparoscopic procedures) or novice (having performed fewer than 10 procedures) operators. The 10 experienced and 15 novice surgeons completed the "two-hand manoeuvres" task from the LAP Mentor basic skills learning environment while wearing a gaze registration system. Performance, movement, gaze, and eye-hand coordination parameters were recorded and compared between groups. Results: The experienced surgeons completed the task significantly more quickly than the novices, used significantly fewer movements, and displayed shorter tool paths. Gaze analyses revealed that experienced surgeons spent significantly more time fixating the target locations than novices, who split their time between focusing on the targets and tracking the tools. A more detailed analysis of a difficult subcomponent of the task revealed that experienced operators used a significantly longer aiming fixation (the quiet eye period) to guide precision grasping movements and hence needed fewer grasp attempts. Conclusion: The findings of the study provide further support for the utility of examining strategic gaze behaviour and eye-hand coordination measures to help further our understanding of how experienced surgeons attempt to overcome the perceptual difficulties inherent in the laparoscopic environment. © 2011 The Author(s).published_or_final_versionSpringer Open Choice, 21 Feb 201

Gaze training enhances laparoscopic technical skill acquisition and multi-tasking performance: A randomized, controlled study

Background: The operating room environment is replete with stressors and distractions that increase the attention demands of what are already complex psychomotor procedures. Contemporary research in other fields (e.g., sport) has revealed that gaze training interventions may support the development of robust movement skills. This current study was designed to examine the utility of gaze training for technical laparoscopic skills and to test performance under multitasking conditions. Methods: Thirty medical trainees with no laparoscopic experience were divided randomly into one of three treatment groups: gaze trained (GAZE), movement trained (MOVE), and discovery learning/control (DISCOVERY). Participants were fitted with a Mobile Eye gaze registration system, which measures eye-line of gaze at 25 Hz. Training consisted of ten repetitions of the "eye-hand coordination" task from the LAP Mentor VR laparoscopic surgical simulator while receiving instruction and video feedback (specific to each treatment condition). After training, all participants completed a control test (designed to assess learning) and a multitasking transfer test, in which they completed the procedure while performing a concurrent tone counting task. Results: Not only did the GAZE group learn more quickly than the MOVE and DISCOVERY groups (faster completion times in the control test), but the performance difference was even more pronounced when multitasking. Differences in gaze control (target locking fixations), rather than tool movement measures (tool path length), underpinned this performance advantage for GAZE training. Conclusions: These results suggest that although the GAZE intervention focused on training gaze behavior only, there were indirect benefits for movement behaviors and performance efficiency. Additionally, focusing on a single external target when learning, rather than on complex movement patterns, may have freed-up attentional resources that could be applied to concurrent cognitive tasks. © 2011 The Author(s).published_or_final_versionSpringer Open Choice, 21 Feb 201

Conscious monitoring and control (reinvestment) in surgical performance under pressure.

Research on intraoperative stressors has focused on external factors without considering individual differences in the ability to cope with stress. One individual difference that is implicated in adverse effects of stress on performance is "reinvestment," the propensity for conscious monitoring and control of movements. The aim of this study was to examine the impact of reinvestment on laparoscopic performance under time pressure

Construct and face validity of SINERGIA laparoscopic virtual reality simulator

Purpose Laparoscopic techniques have nowadays become a gold standard in many surgical procedures, but they imply a more difficult learning skills process. Simulators have a fundamental role in the formative stage of new surgeons. This paper presents the construct and face validity of SINERGIA laparoscopic virtual reality simulator in order to decide whether it can be considered as an assessment tool. Methods Twenty people participated in this study, 14 were novices and 6 were experts. Five tasks of SINERGIA were included in the study: coordination, navigation, navigation and touch, precise grasping and coordinate traction. For each one of these tasks, a certain number of metrics are automatically recorded. All subjects accomplished each task only once and filled in two questionnaires. A statistical analysis was made and results from both groups were compared with the Mann–Whitney U-test, considering significant differences when P ≤ 0.05. Internal consistency of the system has been analyzed with the Cronbach’s alpha test. Results Novices and experts positively rated SINERGIA characteristics. At least one of the evaluated metrics of each exercise presented significant differences between both groups. Nevertheless, all metrics under study gave a better punctuation to the executions accomplished by experts (lower time, higher efficiency, fewer errors. . .) than to those made by novices. Conclusion SINERGIA laparoscopic virtual reality simulator is able to discriminate subjects according to their level of experience in laparoscopic surgery; therefore, it can be used within a training program as an assessment too

Systematic Evaluation of the Teaching Qualities of Obstetrics and Gynecology Faculty: Reliability and Validity of the SETQ Tools

BACKGROUND: The importance of effective clinical teaching for the quality of future patient care is globally understood. Due to recent changes in graduate medical education, new tools are needed to provide faculty with reliable and individualized feedback on their teaching qualities. This study validates two instruments underlying the System for Evaluation of Teaching Qualities (SETQ) aimed at measuring and improving the teaching qualities of obstetrics and gynecology faculty. METHODS AND FINDINGS: This cross-sectional multi-center questionnaire study was set in seven general teaching hospitals and two academic medical centers in the Netherlands. Seventy-seven residents and 114 faculty were invited to complete the SETQ instruments in the duration of one month from September 2008 to September 2009. To assess reliability and validity of the instruments, we used exploratory factor analysis, inter-item correlation, reliability coefficient alpha and inter-scale correlations. We also compared composite scales from factor analysis to global ratings. Finally, the number of residents' evaluations needed per faculty for reliable assessments was calculated. A total of 613 evaluations were completed by 66 residents (85.7% response rate). 99 faculty (86.8% response rate) participated in self-evaluation. Factor analysis yielded five scales with high reliability (Cronbach's alpha for residents' and faculty): learning climate (0.86 and 0.75), professional attitude (0.89 and 0.81), communication of learning goals (0.89 and 0.82), evaluation of residents (0.87 and 0.79) and feedback (0.87 and 0.86). Item-total, inter-scale and scale-global rating correlation coefficients were significant (P<0.01). Four to six residents' evaluations are needed per faculty (reliability coefficient 0.60-0.80). CONCLUSIONS: Both SETQ instruments were found reliable and valid for evaluating teaching qualities of obstetrics and gynecology faculty. Future research should examine improvement of teaching qualities when using SETQ

Development and Validation of a Surgical Workload Measure: The Surgery Task Load Index (SURG-TLX)

Background: The purpose of the present study was to develop and validate a multidimensional, surgery-specific workload measure (the SURG-TLX), and to determine its utility in providing diagnostic information about the impact of various sources of stress on the perceived demands of trained surgical operators. As a wide range of stressors have been identified for surgeons in the operating room, the current approach of considering stress as a unidimensional construct may not only limit the degree to which underlying mechanisms may be understood but also the degree to which training interventions may be successfully matched to particular sources of stress. Methods: The dimensions of the SURG-TLX were based on two current multidimensional workload measures and developed via focus group discussion. The six dimensions were defined as mental demands, physical demands, temporal demands, task complexity, situational stress, and distractions. Thirty novices were trained on the Fundamentals of Laparoscopic Surgery (FLS) peg transfer task and then completed the task under various conditions designed to manipulate the degree and source of stress experienced: task novelty, physical fatigue, time pressure, evaluation apprehension, multitasking, and distraction. Results: The results were supportive of the discriminant sensitivity of the SURG-TLX to different sources of stress. The sub-factors loaded on the relevant stressors as hypothesized, although the evaluation pressure manipulation was not strong enough to cause a significant rise in situational stress. Conclusions: The present study provides support for the validity of the SURG-TLX instrument and also highlights the importance of considering how different stressors may load surgeons. Implications for categorizing the difficulty of certain procedures, the implementation of new technology in the operating room (man-machine interface issues), and the targeting of stress training strategies to the sources of demand are discussed. Modifications to the scale to enhance clinical utility are also suggested. © 2011 The Author(s).published_or_final_versionSpringer Open Choice, 21 Feb 201

Multitask training promotes automaticity of a fundamental laparoscopic skill without compromising the rate of skill learning.

A defining characteristic of expertise is automated performance of skills, which frees attentional capacity to better cope with some common intraoperative stressors. There is a paucity of research on how best to foster automated performance by surgical trainees. This study examined the use of a multitask training approach to promote automated, robust laparoscopic skills.Eighty-one medical students completed training of a fundamental laparoscopic task in either a traditional single-task training condition or a novel multitask training condition. Following training, participants' laparoscopic performance was tested in a retention test, two stress transfer tests (distraction and time pressure) and a secondary task test, which was included to evaluate automaticity of performance. The laparoscopic task was also performed as part of a formal clinical examination (OSCE).The training groups did not differ in the number of trials required to reach task proficiency (p = .72), retention of skill (ps > .45), or performance in the clinical examination (p = .14); however, the groups did differ with respect to the secondary task (p = .016). The movement efficiency (number of hand movements) of single-task trainees, but not multitask trainees, was negatively affected during the secondary task test. The two stress transfer tests had no discernable impact on the performance of either training group.Multitask training was not detrimental to the rate of learning of a fundamental laparoscopic skill and added value by providing resilience in the face of a secondary task load, indicative of skill automaticity. Further work is needed to determine the extent of the clinical utility afforded by multitask training